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Scientific  Progress 


This  project  opens  up  a  brand  new  area  of  research  that  fuses  two  separate  subareas  of  game  theory:  algorithmic  game 
theory  and  behavioral  game  theory.  More  specifically,  game-theoretic  algorithms  have  been  deployed  by  several  security 
agencies,  allowing  them  to  generate  optimal  randomized  schedules  against  adversaries  who  may  exploit  predictability. 
However,  one  key  challenge  in  applying  game  theory  to  solving  real-world  security  problems  is  the  “perfect  rationality” 
assumption  of  the  players,  which  may  not  hold  when  dealing  with  human  adversaries.  Therefore,  it  is  critical  that  we  develop  a 
new  set  of  game-theoretic  algorithms  taking  into  account  adversaries'  bounded  rationality.  To  that  end,  our  accomplishments 
include:  ^integrating  mathematical  models  of  human  decision  making  based  on  Prospect  Theory  and  Quantal  Response  into 
game-theoretic  algorithms;  iijcomprehensive  experiments  with  human  subjects  which  evaluates  the  effectiveness  of  these  new 
algorithm  showing  improvement  over  the  previous  leading  contender;  iii)  enhancing  the  efficiency  of  these  game-theoretic 
algorithms,  thus  the  use  of  these  algorithms  for  computing  security  schedules  in  real-world  settings. 


We  first  investigated  different  theories  in  the  behavioral  literature  to  develop  models  of  human  decision-making  for  predicting 
adversary  behavior.  More  specifically,  we  explored  two  fundamental  theories,  i.e.  Prospect  Theory  [Kahneman  and  Tvesky, 
1979]  and  Quantal  Response  (QR)  Model  [McKelvey  and  Palfrey,  1995],  to  model  the  decision-making  process  of  human 
adversaries 

[Yang  et  al.,  2011]  via  thorough  experiments  with  human  subjects  using  a  simulated  security  game  that  we  developed.  Prospect 
Theory  is  a  Nobel  Prize  winning  theory  which  provides  a  descriptive  model  of  human  decision  making.  Quantal  Response 
Model  originates  from  the  literature  of  discrete  choice  models  [Train,  2003;  McFadden,  1984],  which  models  the  player’s 
behavior  as  a  stochastic  choice  making.  In  experiments  with  human  subjects,  the  defender  strategy  computed  using  the  quantal 
response  model  to  predict  the  human  adversary  significantly  outperformed  its  competitors,  including  the  previous  leading 
contender  COBRA  [Pita  et  al.,  2010]. 

Unfortunately,  while  the  quantal  response  model  outperformed  competitors,  it  presented  a  complex  optimization  challenge. 
Given  the  non-convexity  of  this  optimization  problem,  computing  defender  optimal  strategies  is  an  NP-hard  problem  [Vavasis, 
1995].  We  provided  two  novel  algorithms  (GOSAQ  and 

PASAQ)  to  solve  the  problem  [Yang  et  al.,  2012c].  These  two  novel  algorithms  are  based  on  three  key  ideas:  (i)  use  of  a  binary 
search  method  to  solve  the  fractional  optimization  problem  efficiently,  (ii)  construction  of  a  convex  optimization  problem  through 
a  non-linear  transformation, (iii)  building  a  piecewise  linear  approximation  of  the  non-linear  terms  in  the  problem.  We  also 
provided  proofs  of  approximation  bounds,  detailed  experimental  results  showing  the  advantages  of  GOSAQ  and  PASAQ  in 
solution  quality  over  the  benchmark  algorithm  (BRQR)  and  the  efficiency  of  PASAQ. 

Given  that  many  real-world  security  problems  are  massive,  such  as  for  Federal  Air  Marshals  [Kiekintveld  et  al.,  2009],  further 
scaling-up  for  computing  defender  strategy  incorporating  models  of  adversary  bounded  rationality  is  needed.  Unfortunately, 
previously  proposed  branch-and-price  approaches  fail  to  scale-up  given  the  non-convexity  of  such  models,  as  we  show  with  a 
realization  called  COCOMO.  Therefore,  we  presented  a  novel  cutting-plane  algorithm  called  BLADE  to  scale-up  SSGs  with 
complex  adversary  models, with  three  novelties:  (i)  an  efficient  scalable  separation  oracle  to  generate  deep  cuts;  (ii)  a  heuristic 
that  uses  gradient  to  further  improve  the  cuts;  (iii)  techniques  for  quality-efficiency  tradeoffs. 

Technology  Transfer 

The  work  initiated  in  this  grant  led  to  the  use  of  the  quantal  response  model  in  security  games.  This  model  was  used  in  the 
original  PROTECT  application  developed  for  the  US  Coast  Guard  for  patrolling  the  port  of  Boston.  The  idea  here  is  to  patrol  in  a 
randomized  fashion  yet  giving  higher  weights  to  more  important  targets.  The  application  went  into  effect  in  201 1  and  was  used 
by  the  US  Coast  Guard  in  regular  patrolling;  later  a  newer  version  of  PROTECT  got  implemented.  The  application  won  the 
prestigious  Wagner  prize  of  the  INFORMS  society. 


